Web Survey Bibliography
Purpose of the study: The quality of mobile-only Web surveys is up for discussion: some argue that surveys requiring a smartphone to participate should be avoided; others tout their usefulness for health and travel research. We help inform this discussion by estimating the magnitude of three sources of error in a mobile Web survey. Design/methodology/approach: 1385 members of the Longitudinal Internet Studies for the Social Sciences (LISS) panel were asked to answer the same questions, once using a smartphone and once using a personal computer (PC). We use the PC Web survey as a benchmark, and deviations from the benchmark are regarded as error. To estimate coverage errors in the mobile Web survey, we compared those with their own smartphones (71%) to the full sample. To estimate nonresponse errors, we compared those who responded on their smartphone (73%) to the covered sample. Finally, to estimate measurement differences, we compared how the same people responded when using their smartphone and when using their PC. Findings: We find large non-coverage error errors relative to nonresponse and measurement errors. Furthermore, the non-coverage errors were not consistently offset by the other sources of error. This suggests that limiting Web surveys to mobile Web users only is risky for general population surveys. We repeated the analyses, but this time counted those who were uncovered as covered because in reality they were sent a borrowed phone to participate. This strategy of providing phones appeared to be effective: coverage errors were eliminated (by definition), and there were no unintended effects on nonresponse or measurement errors. Originality/value: This study provides an update on earlier estimates by Fuchs and Busse (2009) of coverage errors for mobile-only surveys. We utilized several measures that one might want to measure in a smartphone survey related to health, technology, and travel. Since these measures were collected in a parallel PC Web survey, we know the characteristics of those who did or did not participate in the mobile Web survey. Research limitations/implications: This research is a first step towards understanding the effect of mobile-only Web surveys on data quality using total survey error framework. Future research should consider other question domains and survey contexts. Practical implications: These findings help practitioners answer the important question of whether mobile-only Web surveys are becoming a viable alternative to traditional PC-based methods for their research topics.
Web survey bibliography - Mobile phone surveys (305)
- Measuring Subjective Health and Life Satisfaction with U.S. Hispanics; 2017; Lee, S.; Davis, R.
- Device and Internet Use among Spanish-dominant Hispanics: Implications for Web Survey Design and Testing...; 2017; Trejo, Y. A. G.; Schoua-Glusberg, A.
- How to Design a Web Survey Using Spring Boot With MYSQL: a Romanien Network Case Study; 2017; Bucea-Manea-Tonis, Ro.; Bucea-Manea-Tonis, Ra.
- Analyzing Survey Characteristics, Participation, and Evaluation Across 186 Surveys in an Online Opt-...; 2017; Revilla, M.
- Data chunking for mobile web: effects on data quality; 2017; Lugtig, P. J.; Toepoel, V.
- Mobile-only web survey respondents; 2016; Lugtig, P. J.; Toepoel, V.; Amin, A.
- Development and Pilot Test of a Mobile Application for Field Data Collection; 2016; Chiappetta, L.; Kerr, M. M.
- Are Initial Respondents Different from the Nonresponse Follow-Up Cases? A Study of Probability-Based...; 2016; Zeng, W.; Dennis, J. M.
- A Feasibility Study of Recruiting and Maintaining a Web Panel of People with Disabilities; 2016; Chandler, J.
- Why Do Web Surveys Take Longer on Smartphones?; 2016; Couper, M. P.; J. J.Peterson, G. J.
- Web surveys for offline rural communities ; 2016; Gichohi, B. W.
- Pre-Survey Text Messages (SMS) Improve Participation Rate in an Australian Mobile Telephone Survey:...; 2016; Dal Grande, E.; Chittleborough, C. R.; Campostrini, S.; Dollard, M.; Taylor, A. W.
- Short and Sweet? Length and Informative Content of Open-Ended Responses Using SMS as a Research Mode; 2016; Walsh, E.; Brinker, J. K.
- Collecting Data from mHealth Users via SMS Surveys: A Case Study in Kenya; 2016; Johnson, D.
- Online Surveys are Mixed-Device Surveys. Issues Associated with the Use of Different (Mobile) Devices...; 2016; Toepoel, V.; Lugtig, P. J.
- Using Mobile Phones for High-Frequency Data Collection; 2015; Azevedo, J. P.; Ballivian, A.; Durbin, W.
- Who Are the Internet Users, Mobile Internet Users, and Mobile-Mostly Internet Users?: Demographic Differences...; 2015; Antoun, C.
- Mobile Research Methods: Opportunities and challenges of mobile research methodologies. ; 2015; Toninelli, D. (Ed.); Pinter, R.; de Pedraza, P.
- Web Surveys Optimized for Smartphones: Are there Differences Between Computer and Smartphone Users?; 2015; Andreadis, I.
- Usability of the ACS Internet Instrument on Mobile Devices; 2015; Horwitz, R.
- GreenBook Research Industry Trends Report; 2015; Murphy, L. (Ed.)
- Emerging Technologies: The Rise of Mobile Devices: From Smartphones to Smart Surveys; 2015; Buskirk, T. D.
- PayPal? An Incentive to Check-out?; 2015; Franklin, J.; Rasmussen, C.; Pruitt, J.; Waller, D.
- Designing Bonsai Surveys: The small but perfectly formed survey experience to meet the needs of the...; 2015; Puleston, J.
- Open narrative questions in PC and smartphones: is the device playing a role?; 2015; Revilla, M.; Ochoa, C.
- Recruiting Respondents for a Mobile Phone Panel: The Impact of Recruitment Question Wording on Cooperation...; 2015; Busse, B.; Fuchs, M.
- Internet Research in Psychology; 2015; Gosling, S. D., Mason, W.
- Are Tailored Outreach Efforts Too Costly? An Assessment of a Responsive Design Approach to Control Costs...; 2015; Epps, S. R.; Getman, D. P.; Hall, L. M.; Hunter, J. A.
- Evaluating Visual Design Elements for Data Collection and Panelist Engagement; 2015; Christian, L. M.; Harm, D.; Langer Tesfaye, C.; Wells, T.
- Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour...; 2015; Liebe, U., Glenk, K., Oehlmann, M., Meyerhoff, J.
- When it comes to mobile respondent experience and data quality, survey design matters; 2014; Mitchell, N.
- The Changing Landscape of Technology and its Effect on Online Survey Data Collection; 2014; Mitchell, N.
- The need of and the demand for completing surveys on mobile devices; 2014; Toninelli, D., Revilla, M., Ochoa, C.
- Survey participation via mobile devices in a probability-based online-panel: Prevalence, determinants...; 2014; Poggio, T., Bosnjak, M., Weyandt, K.
- Keeping Surveys Valid, Reliable, and Useful: A Tutorial; 2014; Greenberg, M. R., Weiner, M. D.
- Improving Response Rates and Questionnaire Design for Mobile Web Surveys; 2014; de Bruijne, M., Wijnant, A.
- Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison; 2014; Ansolabehere, S., Schaffner, B. F.
- Nonresponse and Mode Effects in Self- and Interviewer-Administered Surveys; 2014; Atkeson, L. R.; Adams, A. N.; Alvarez, M. R.
- Do Web surveys facilitate reporting less favourable opinions about law enforcement?; 2014; Boivin, R., Cordeau, G.
- Question Grouping and Matrices in Web Surveys: Using Response and Auxiliary Data to Examine Question...; 2014; Bilgen, I., Stern, M. J.
- The Grouping of Items in Mobile Web Surveys; 2014; Mavletova, A. M., Couper, M. P.
- Moving answers with the GyroScale: Using the mobile device’s gyroscope for market research purposes...; 2014; Luetters, H., Kraus, M., Westphal, D.
- Students First Choice – the influence of mobile mode on results; 2014; Maxl, E.
- Device Effects: How different screen sizes affect answer quality in online questionnaires; 2014; Fischer, B., Bernet, F.
- Moving towards mobile ready web panels; 2014; Wijnant, A., de Bruijne, M.
- Online mobile surveys in Italy: coverage and other methodological challenges; 2014; Poggio, T.
- Comparison of Three Modes for a Crime Victimization Survey; 2013; Laaksonen, S., Heiskanen, M.
- Understanding Society Innovation Panel Wave 5: results from methodological experiments; 2013; Auspurg, K., Burton, J., Cullinane, C., Delavande, A., Fumagalli, L., Iacovou, M., Jaeckle, A., Kaminska...
- A Comparison of Results from a Spanish and English Mail Survey: Effects of Instruction Placement on...; 2013; Wang, K., Sha, M.
- Intra-individual variation of extreme response style in mixed-mode panel studies; 2013; Aichholzer, J.